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Abstract 


In lecent yens itentive concatenated decoding has regained popularity staiting with the 
lemarkable lesults piesented in a paper by a gioup of Ficnch lescucheis They 
intioduced i new family of convolutional codes nicknamed Tut bo codes aftei the 
lesemblance with the tuibo engine A turbo code is built fiom p uallel concatenation of 
two lecuisive systematic codes linked together by nonunifoim interleaving Decoding 
is done iteratively by two maximum a posteriori probability decoders each using the 
decoding lesults fiom other one Foi sufficiently large intei leavei size the erroi 
peifoimance seems to be close to Shannon limit 

In this thesis we examine the perfonnance of turbo codes on the additive white 
Guisst tn noise chinnel The influence of the size of encodei memoiy diileient type 
and size of intei letvei on decoding is examined A new dyn ivnic decoding algorithm is 
pioposed which uses vanable number of iteiations A modiheUion to odd even 
intei leavei has been suggested Principle of tuibo code his been extended to in 
encodei which uses thiee recuisive systematic convolutional encodei s We show thit 
odd even intei leavei peiforms bettei aftei modification We ii so show that dynamic 
algonthm lequues less time as compaied to the other algoiithni for achieving the same 
eiror peifoimance and that the extended turbo code can achieve bettei results with 


small intei leaver size 
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Chapter 1 


Introduction 


In a digital communication systems information is represented is i sequence of bin iry 
bits After certain processing the resultant binary bits are modulated to analog signal 
waveform before transmission over a communication channel The communication 
channel introduces noise and interference corrupting the transmitted wavefoim At the 
receivei the corrupted received waveform is mapped back to the binaiy bits aftei due 
estimation process Errors occur in the bit stream due to the ti insmission impairments 
and the number of errors depends on the amount of noise ind interference m the 
communication channel 

Channel coding is often used in digital communication system to protect the 
digital information fiom noise and interference by correcting a numbei of bit errors that 
occur due to the channel impairment Channel coding is accomplished mostly by 
selectively introducing redundant bits into the transmitted infoimation stream These 
additional bits facilitate detection and correction of bit errois in the received data 
stream and provide more reliable information transmission Nituially channel coding 
has become an area of increasing importance in communications The leasons for this 
are mainly its usefulness in preserving the data integrity and its potential of providing 
tradeoffs in a communication system design In any system that handles large amount 
of data uncorrected and undetected errors can degrade performance response time and 
possibly increase the need for human intervention The coding can change data quality 
from problematic to acceptable If a communication system has no problem with data 
quality the designer can think of discarding or downgrading the most expensive and 
troublesome elements and overcome the resulting loss in performance by using an 
appropriate error correcting coding In this sense the error control is a system design 
technique that can fundamentally change the tradeoff in a communication system 
design 
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1 1 Types of Channel Codes 

There are two main types of channel codes namely block codes and convolution 
codes There is much difference between block codes and convolution codes Block 
codes aie based ngoiously on finite field anthmetic and abstract ilgebra They can be 
used either to detect or conect eiror or both Block codes accept a block of k 
information bits and pioduce a block of n coded bits By pi edetu mined lules n k bits 
are added to the k infoimation bits to foim the n coded bits Commonly these codes lit 
lefeired as (n k) block code Some of the commonly used block codes are binaiy 
Hamming codes Golay codes BCH codes and non binaiy Reed Solomon codes 
Seveial ways exit to decode block codes and estimate the miounation bits These 
decoding techniques will not be discussed here [20] 

Convolution codes are one of the most widely used th inntl codes in the 
practical communication system These codes are developed with a separate 
mathematical structuie and are primarily used in real time eiroi collection Convolution 
codes convert the entire data stream into one single code woid The encoded bits 
depend not only cuirent k input bits but also on past input bits The m un decoding 
strategy is based on the widely used Viterbi algorithm [20] 

1 2 Racing Towards the Shannon Limit 

The history of error control coding and information theoiy began in 1948 when 
Claude E Shannon published his famous paper A Mathematical theory of 
Communication In his paper Shannon showed that eveiy communication channel has 
a parameter C (measured in bits per second) called the channel capacity and one can 
transmit digital information through the channel at a rate up to the channel capacity 
with arbitranly small probability of error The minimum value of bit energy to noise 
ratio (Eb/No) to achieve this capacity limit is -1 59 dB and known is a Shannon limit 

We know from the coding theory that increasing the code woid length oi 
encoder memoiy greater protection or coding gain can be achieved At the same time 
complexity of maximum likelihood (ML) decoding algorithm incieases exponentially 
and the algorithm becomes difficult to implement The mcieased euor correction 
capability of long block codes or convolution codes requires a veiy high computational 
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effoit This led to research foi new coding schemes which could icplace ML decoding 
algorithm with simpler decoding strategies Using these iteiativo technique one c in 
approach the performance of ML decoding algorithm The encoding technique used in 
iterative decoding are those coding techniques which combine different code m such a 
way that each of them can be decoded independently The codes in this category aie 
product block codes and concatenated codes A common featuie of these techniques is 
that decoding can be done sequentially using one decodei it i time (1 e one code is 
decoded anothei decodu is used foi the next code and so on) 

Product codes weie first attempted for achieving highei coding gain without 
lequning the decoding complexity of long codes Unfoilun itely the iltein ltive 
decoding of the component codes did not produce the improvement in peifoimance as 
was expected even though the enor coirection powei of the pioduet code incieased is 
a whole [20] 

Better lesults were obtained with concatenated codes The component codes ai e 
called the inner and outer codes First the inner code vector is decoded then decoded 
bits are again decoded according the outer code used All these codes have 
disadvantage that no information is exchanged between the two encoders 

In 1993 Berrou et al introduced a new coding scheme which has been 
nicknamed as Turbo Code [1] It was one of the most impoitant developments in 
coding theory foi many years It has been shown that a tuibo code can achieve 
performance within 1 dB of Shannon limit The main advantage of these codes when 
used together with iterative decoding scheme is low complexity in spite of high 
peifoim ince which makes it suitable for any application which lcquires lower signal to 
noise ratio It is therefore part of the standard for the thud geneiation mobile 
telecommunication system 

1 3 A Brief Overview of the Turbo Code 

The turbo code encoder is a parallel concatenation of two tecursive systematic 
convolutional (RSC) encoders called the constituent encoders The information block 
which has the finite length is encoded by first constituent encodei but intei leaved 
before it enters the second constituent encoder Note that intei leaver opeiates on an 
information sequence and not on a code sequence The intei leaver size equals the 
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information block length The output of the constituent encodeis is generally punctured 
to increase the code rate 

The encoder is used in conjunction with a suboptimal decoding scheme based 
on a modified version of the maximum a posteriori (MAP) algorithm introduced by 
Bahl et al [3] 

1 4 Objective of the Thesis 

The objective of the thesis is to study the performance of turbo codes in the 
additive white gaussian noise (AWGN) environment Various parameter affect the 
performance of the turbo codes these are memory of the constituent encoders number 
of iterations used in the decoding process puncturing and choice of interleaver Effects 
of all these parameters have been studied through simulation During the decoding of 
the turbo coded information blocks some blocks require less number of delations to 
become error free whereas some error prone blocks require moie number of iterations 
decoding algorithm with fixed number of iteration keeps on iterating a block till the last 
iteration even it become error free after few iterations so a dynamic algorithm with 
variable number of iteration has been proposed Relative peiformance of various 
interleavers has been studied The principle of turbo code h is been extended to an 
encoder which uses three encoder and two interleavers 

1 5 Organization of the Thesis 

In this thesis a new class of convolution codes which is called turbo code is 
presented Chaptei 2 introduces the basic turbo code encodei md decodei The tui bo 
code encoder is paiallel concatenation of two recursive system itic convolution (RSC) 
codes separated by an interleaver This chapter shows the constiuction of RSC encodei 
from a nonrecuisive nonsystematic (conventional) convolution encoder It discusses the 
similarities and difference between the conventional and RSC encoder in terms of their 
intrinsic properties Furthermore this chapter also describes the structure of the turbo 
code decoder Chapter 3 discusses the function of interleave! and describes many 
different types of interleavers that are suitable for turbo code encoder Chapter4 
investigates the peifoimance of turbo codes through extensive computer simulation 
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The simulation setup is carefully detailed Many simulation lesults are then presented 
to show the impoitant characteristics of turbo code Chaptei *5 then summarizes the 
impoitant finding about turbo codes and concludes the thesis 
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Chapter 2 


Turbo Code Encoder and Decoder 


This chaptei describes the turbo code encodei ind decodei and then 
components in detail The well known turbo code encoder is built using two identic il 
lecursive systematic convolutional (RSC) codes with parallel concatenation [1] An 
RSC encoder is typically a r — \ code and is termed a component encodei An 

interleavei sepaiates the two component encoder Only one of the system ltic outputs 
from the two component encoders is used because the systematic output fiom the othei 
component encoder is just a peimuted version of the chosen systematic output Fig 2 I 
shows the fundamental turbo encoder 



k )h^ 

RSC Encodei 1 

► 

x i 

P 



► 


— «J 

Interleaver 

► 

RSC Encodei 2 

p. 


Fig 2 1 Fundamental turbo code encodei 

2 1 Convolutional Encoder 

A convolution code introduce the redundant bits into the data stream through 
the use of linear shift Registers as shown in the fig 2 2 

The information bits are input into the shift registers and output encoded bits aie 
obtained by modulo 2 addition of the input information bits and the contents of shift 
registeis at various stages of delay The connections of modulo 2 adders were initially 
developed heuristically with no algebraic or combinatorial found ltion 
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Fig 2 2 Example of convolution encoder with x* as input information bit stream 
and c‘ as an output encoded bit stream 


The code late for a convolution code is defined as 

= k_ 

n 


(2 1 ) 


where k is the number of parallel input information bits and n is the number of parallel 
output encoded bits at one time interval The constraint length K foi a convolution code 
is defined as 


K=v+1 


(2 2 ) 


where v is the maximum number of stages (memory size) in any shift registei The shift 
registei stores the state information of the Convoltuional encodei and the constraint 
length relates the number of bits upon which the output depends For the convolution'll 
encodei shown in fig 2 2 the code rate r=2/3 the maximum memory size v =3 and the 
constraint length K=4 


2 2 Recursive Systematic Convolutional (RSC) Encoder 

Figure 2 3 shows a conventional convolutional encoder This convolutional 
encoder is represented by the generator sequences gi=[l 1 I] and go=[l 0 1] and can be 
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equivalently represented in a more compact form as G=[gj g ] 

The recuisive systematic convolutional (RSC) encodei is obtained from the 
nonrecursive nonsystematic (conventional) convolutional encodei by feeding back one 
of its encoded outputs to its input 

The RSC encoder of this conventional convolutional encodei is represented as 
G=[l go/gi] where the first output (represented by gi) is fed b ick to the input In the 
above i ep resen tati on 1 denotes the systematic output and g\ is ted back to the input of 
the RSC encodei Fig 2 4 shows the resulting RSC encodei 



Fig 2 3 Conventional convolutional encoder with i = l/2 and K=3 



8 







2 2 1 Trellis Termination 

Foi the conventional convolutional encoder trellis is tei minuted by insetting v=K 1 
additional zero bits after the input block These additional bits dnve the conventional 
convoltutional encoder to the all zero state (trellis termination) However this strategy 
is not possible m RSC encoder due to the feedback The additional termination bits foi 
the RSC encoder would depend on the state of the encoder at the end of input block and 
are naturally very difficult to predict Furthermore if the termination bits for the fast 
encoder are found other component encoder cannot be driven into the all zero state due 
to the piesence of interleaver Fig 2 5 shows a scheme that has been developed m [17] 
for terminating the RSC encoder 



Fig 2 5 Trellis termination scheme for RSC encoder 

For encoding the input sequence the switch is turned on to position A and for 
terminating the trellis the switch is turned on to position B at the end of input block 


2 3 Recursive and Nonrecursive Convolution Encoder 

The nature of recursive and non recursive convolution encoder is best examined 
by an example Fig 2 6 shows a simple non recursive convolution encoder with 
generator sequences gj=[l 1] and g 2 =[l 0] Fig 2 7 shows the equivalent recursive 
encoder of fig 2 6 with G =[1 g 2 /gi] 
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Ci=[l 10 0] 


x=[l 0 0 0] *f + W 


frj D 


^ c =[1 0 0 0] 


Fig 2 6 Non recursive r=l/2 and K=2 convolutional encoder with 
input and output sequences 


x=[l 0 0 0] 



>■ 




ci=[l 0 0 0] 


c 2 =[l 1 1 1] 


Fig 2 7 Recursive r= 1/2 and K=2 convolutional encoder 
of fig 2 6 with input and output sequences 

In the above figures flow of input bits is from left to right From fig 2 6 and fig 
2 7 given the same input sequence the non recursive encoder pioduces an output code 
word with weight of 3 and the recursive encoder produces an output code word with 
weight of 5 hi genetal a recursive convoltutional encoder tends to produce codewords 
with mcieased weight lelative to a non recursive encoder This lesults in fewer code 
woids with lower weights and this leads to better eiroi peifoun ince Foi Tuibo codes 
the main purpose of the RSC encoders as component encodeis is to utilize the lecursive 
nature of the encodeis and not the fact that encoders aie system itic Fig 2 8 shows the 
state diagram of the non recursive encoder 

Fig 2 9 shows the state diagram of recursive encoder Clearly the state 
diagrams of the encoders are very similar Furthermore two codes have the same 
minimum free distance and can be described by the same trellis structure [8] 
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0/10 


Fig 2 8 State diagram of nonrecursive encodei m fig 2 6 



Fig 2 9 State diagram of recursive encoder in fig 2 7 


2 4 Concatenation of Codes 

A concatenated code is composed of two separate codes that are combined to 
form a large code [19] There are two types of concatenation namely serial and paiallel 
concatenations Fig 2 10 shows the serial concatenation scheme for transmission 


Input 


Output 



Fig 2 10 Serial concatenated code 

The total code rate for serial concatenation is 

k.k 

r,,= 


(2 3) 
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which is equal to the product of two codes rate Fig 2 1 1 shows a parallel concatenation 
scheme foi transmission 



Fig 2 1 1 Parallel concatenated code 


The total code rate for parallel concatenated code is 

<■„=— I— (24) 

n, + n 

For both serial and parallel concatenated schemes an interleave! is often used between 
the encoders to impiove the burst error correction capability or to mciease the 
randomness of the code 

Tui bo codes use parallel concatenated coding scheme However the tuibo code 
decoder is based on the serial concatenated decoding scheme The serial concatenated 
decoders aie used because they perform better than the parallel concatenated decoding 
due to the fact that the serial concatenation scheme has the ability to share the 
information between the decoders whereas the decoders for the parallel concatenated 
coding scheme pumarily decode independently 


2 5 Puncturer 

Puncturing is often used m order to achieve high coding rates When puncturing 
is used some of the parity bits generated by component encoder 1 and component 
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encodei2 are periodically deleted according to a chosen perfoi ition pattern defined by i 
matrix P For a global late of R=l/2 P is chosen as 

'1 0 

-0 l 

This means that parity bits from encoder 1 are sent every odd time and parity bits from 
encoder2 aie sent every even time Fig 2 12 shows a standard tuibo encodei 



Fig 2 12 Standard turbo code encoder 

2 6 The Decoder 

Just prioi to discovery of turbo codes there was much interest in the coding 
community in suboptuml decoding strategies for concaten ited codes involving 
multiple (usually two) decoders operating cooperatively Most of the focus was on a 
type of Yiteibi decoder which provides soft output (oi lelubility) inform ition to a 
companion soft output Viterbi decoder for use in a subsequent decoding Recently 
some attention was the symbol by symbol maximum a posterion (MAP) algorithm of 
Bahl (BCJR algorithm) et al [ ] published over 20 years ago It was the later algorithm 
often called the BCJR algorithm that Berrou et al utilized in the iterative decoding of 
tuibo codes We discuss the BCJR algorithm employed by each of the constituent 
encoders We first discuss a modified version of the BCJR algorithm for performing 
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symbol by symbol MAP decoding we then show how this algonthm is incorporated 
into an iteidtive decoder employing two BCJR MAP decoders 

2 6 1 The Modified BCJR Algori thm 

In the following derivation we consider rate half RSC Let S be the set of all 
states of RSC encoder The input to the encoder is data sequence d =(d| dfs) The 
outputs of the encodei aie systematic data bit sequence x =(v, r A )=d ind paaty bit 

sequence x p = (x( x' N ) These output bits are modulated with i BPSK modulator and 

sent ovei an AWGN channel At the leceiver the log likelihood latio L (d k ) is defined 
as 

) m [o g f (^ = 1 1 observation) (2 S) 

P (d k = 01 observation) 

Where P, (d k = llobservation) i=0 1 is the a posteriori probability (APP) of data bit d k 
The encoder output at time k is translated into +1/ 1 values by the BPSK modulator 

ai=2d k 1 
b k =2jt' 1 

The pan ( r k b k ) defines the transmitted symbol C k at time k 
The sequence of transmitted symbol is given by 

Cf=(C, C 2 C N ) (2 6) 

heie the subscnpts denotes the time index of bit in a particul u block of size N Which 
is the input to a discrete Gaussian memoryless channel whose output sequence is 
defined as 

R" = (RiR? Rn) (2 7) 

with R k =( y k , y [ ) being the received symbol at time k y k and i ' aie defined as 

y A =(2d k l)+p k (2 8) 

y'=(2x' l)+q k (2 9) 

where p k and q k aie two independent normal variables with vtnance a 7 The APP of 

decoded data bit d k can be derived from the joint probability defined by 
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(2 10) 


X k (m) = P ( d k =i,S k = m I R, v ) 

With i=0 1 and m=0 1 2 V 1 The APP of decoded data bit d k is thus equal to 

P(^=j|Rf') = X^ 0 «) ( 211 ) 

where the summation is over all m=0 1 2 V 1 From (2 5) ind (2 11) the L (d k ) 
associated with a decoded bit d k can be written as 

U d k ) = \ og —-—- (2 12) 

Zuhi™) 

This lepiesents the soft output of MAP decoder This can be used as input to anothei 
decodei in a concatenated scheme or in the next iteration in an iterative decodet 
Finally the decoder can make a hard decision by comparing L (d k ) to a threshold equal 
to zero 

if L(d k )>0 the decoded bit is 1 
ifL(d k )<0 the decoded bit is 0 

In older to compute the APP of decoded data bit d k as in (2 1 1) it is useful to define the 
following probability functions 


a k (rn)=P 1 (S k =ml Rf ) 

(2 H) 

Pl(m)=Pi(R"| IS, =m) p(R „ i|R[) 

(2 14) 

Y, (R k m m )=P (d k =i R k S k =m IS k i=m ) 

(2 15) 


Wheie st ate m at tunc k is denoted by S k =m 
Recalling Bayes mle 


P(B I A) = 


PjAAB) PjB) 
P(A) 


and the expiession toi the conditional piobability 

Combining these two equalities we obtain the following well known relation 

P (A B)=P (AIB) P (B) 

which tuins out to be very useful for the following derivation 


(2 16) 
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Aftei applying the (2 16) in the expression (2 11) it becomes 
P(d k =i\ RD = S P (d k = «,S t = ml R?) =£P {d k = i 5, = /n,Rf ) 

Since the obseivations are independent of time this can be rewutten as 

2m -. a ^ 

Applying (2 16) to the numerator and denominator gives 

IP(Rr,l^ =i,5* =m,Rf) P (rf* =*,5 t =m Rf) 

POOR}) P(Rfj 

Using the piopeity that events after time k are not influenced by the obseivitions ol 
Rf and bit di, if state Sk is known (l e Markov propeity ol the soutce) this can be 
simplified to 


^ P r (R N k+l \S k = m) P(^=»,5 t =mRf) 

L P (R^IRf) P (Rf) 

wheie the fust term is recognized as [3 k (m) 

The second term can be rewritten as 

P(rf t =i,S k = m,Rf) P(rf» =hS, = m,Rf ' R t ) 
P (Rf ) P (Rf”' jR; ) 

P(d k =i,S k =m,R k IRf ') p (Rf" 1 ) 

, 1-1 - 


(2 17) 


P r (R k IRf ') P (Rf -1 ) 


(2 18) 


The fust equality comes from the time independence of the obseivation and the second 
fiom (2 16) The second term can now be cancelled Notice that expanding the 
denominatoi over all possible states m=0 1 2 V 1 at time k 1 ind all possible inputs 
i=0 1 gives 

P(R, IR:-'>=XX? (<*, =«.s. =«,*, IRf ') < 2 19 > 

n / 

So the ptoof continues simply with the numerator which can be expanded over all 
states at time k 1 as follows 

P(d L =hSi *)= = i ’) (2 20) 


Again using the time independence of the observation results m 


16 



(d k =i,S k =m,S k _ ] =m ') 1 

and with (2 16) this becomes 


p so 


Now the substitution of the second term with ot k i(m’) and the first term with 
Y(R k mm 5 ) gives 

=X^ ( d k =l ’S k =m,R k IS t _, = j»’,Rf ') a k _ l (m’)='£ i y (R k mm) a kX (jn) 
Equation (2 17) can now be expressed with (2 19) as 


P(d k =iS k =n,r k \R i l ') 


X / ( R k m m ) a k I On ) 

/>(/?* IRf) XXXm--)« A >0 

Interchanging the sums over i and m is allowed since i(m’) does not depend on 
l yielding 

Xm m m ) a k-\0n) 


XXXr(^ m m ) a k i oo 

Combining (2 17) with (2 21) gives 


(2 21 ) 


P(rf. =HRf , )=- i ( 


XX/ (** m m ) a * i< m )A( m > 


XXXr^* w m k i< m > 


(2 22 ) 


Finally setting i=0 and i=l and dividing gives 


L(dO =log 




ISr.W m (m )/3 k (m) 


P(d k = OIR") "XX^o(R* m m)a k _ x (m)f3 k {m) 

since the denominatoi of (2 22) in both cases is equal 


(2 23) 


2 6 11 Recursive calculation of a k (m) and (3 k (m) 

The recursive calculation of OCk(m) and pt(m) is now denved 
a k (m) was defined in (2 1 3) as 
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a k (m)=P,(S k =ml R* ) = P r (S k =m R* ) 


P( R\) 

The second teim of (2 17) can be obtained by expanding a k (m) as defined in (2 13) 
ovei the all possible inputs 


Ok(in)= 


X 


P(d k = O, =mX) 
P( Rf) 


Substituting the teim in the sum with (2 21) results in a toiwud lecuision for a k (m) 
given by 


0Ck(m) = 


II 7 (R k mm) a k , (m ) 
XXXr^i mm ) 




(2 24) 


with the initial conditions ocq(O) = 1 and Oo(m)=Q for Vm * 0 


Expanding (3 k (m) as defined in (2 14) over all possible states m=0 1 
possible inputs i=0 1 at time k+1 gives 


P r (d k — i,S k+] —m’, R t+ >7? i+ | I S k — m) 

POO Rf) 

wheie again the time independence of the observation was used 



2 V 1 and all 


Using Bayes s lule the numerator becomes 

XX P < R m = in’) P(d k+] = i,S M = m’,R k+] I S k =m) 

I / 


The backwaid lecuision tor (3k(m) is then given by 


Pk(m) = 


XX YMm A+ i( m ) 


XXX^^W nim)a k {m) 


(2 25) 


I M / 

with the initial conditions (3 n( 0) = 1 and Pn(iti) = 0 for V m 0 

In summary modified BCJR MAP algorithm computes the L(d k ) according to 
(2 23) where the a and (3 s are computed recursively via (2 24) and (2 25) 
Computation of the probabilities y\ (Rk m m) will be discussed shoitly 
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2 6 2 Iterative MAP Decoding 

Let El and E2 be the notations for encoderl and encodti 2 tnd D1 and D2 aie 
notitions foi decoder 1 and decoder2 

Fiona Bayes rule the L (d k ) for MAP decoder can be wi itten as 


L(cl k ) = log 


P ( observation I = 1) 
P ( observatiob I d k = 0) 


+ log 


Picl^l) 
P{cl k =0) 


with the second teirn representing a prion information Since P r (d k =l) = P,(d k =0) 
typically the a piion term is usually zero for conventional decodeis However the 
iteiative decoder D1 receives extrinsic information for each d k fiom D2 which serves 
as a pi 101 1 mfoimation Similarly D2 receives extrinsic inform ition from D1 The idei 
behind extrinsic mfoimation is that D2 provides soft mfoimation to D1 for each d k 
using only mfoimation not available to D I (i e E2 parity) D 1 does likewise for D2 
We now show calculation of y, (R k m m) 


Equation (2 15) can be rewritten as 

Yi ( R k m m) = P(R k ld k =i S k =m S k |=m ) P(d k =ilS k =m S k i=m ) P(S k =mlS k ,=m ) 
since R k consists of y k the systematic information sequence and y k the parity 

sequence which are independent of each other The first teim therefore can be written 
as a pioduct of two leceived bits That is 


P (R k ld k =i S k =m S k ,=m ) = P( y k ld k =i S k =m S k ,=m ) P( y[ ld k =i S k =m S k ,=m ) 

( ( id 


where 


1 


P(yJ)=-^= e 

P( y[\) 


1 


and 


( / M Of 

la 


crV 2n 


where a k and b k is the modulated output associated with the blanch fiom state m at step 
k 1 to state m at step k if the corresponding d k was equal to i 

P (d k =ilS k =m S k i=m ) is eithei zero or one depending on whether bit i is 
associated with the transition from state m to m The probability P(S k =mlS k pm ) 
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depends directly on the a -priori probability of the information bit d k we use the a 
prion piobability of bit d k given to us by the previous decoder in 

P L «/ ) 

P(S k =mlS k i=m ) =- — - 

\ + e L u 1 

If P(d k =llS k =m S k i=m ) = 1 and 

P(S k =mlS k i=m )= 1 r — 

\ + e L (</ ' 


If P (d k =01S k =m S k i=m ) = 1 where L (d k ) =log— — * — — 

P(d k = 0 ) 

With the application of these probabilities (2 23) can be written is 

, SS 7i ( y' k m m ) a k |(m ) /?*(m) 

L(d k )= (- L (d k ) + log •==-== — — — 

2cr i ('” ) A(«) 


(2 26) 


The fust term in (2 26) is called the channel value the second term represents the a 
pi ion mfoimation about d*, provided by a previous decodei and the third term 
represents extrinsic information that can be passed on to subsequent decoder Fig 2 1 1 
shows a turbo code decoder 



In the fig 2 H MAP decoder 1 uses noisy version of the systematic bits and received 
noisy panty bits generated by the first RSC encoder It also uses the extrinsic 


20 







infotmation generated by the MAP decoder 2 however for the first iteration extunsic 
information geneiated by the MAP decoder 2 is zero Using these three values MAP 
decoder 1 computes the extrinsic information that to be used by the MAP decoder 2 
MAP decodei 2 uses the interleaved received systematic bits parity bits generated by 
the second RSC encoder and interleaved extrinsic information generated by the MAP 
decodei 1 Systematic bits and extrinsic information is interleaved because second RSC 
encodei works on the interleaved information sequence This piocess keeps on until the 
last iteiation After the last iteration MAP decoder 2 computes the log likelihood ratio 
as defined in (2 26) from theses log likelihood values final decision for each bit is 
made 

2 7 Multiple Turbo Code 

We have extended the principle of turbo code If we use more than two j 

encoders in the turbo code then this type of encoder is called multiple turbo encoder 
We have used an encoder which uses three RSC constituent encoders First RSC 
encodei opeiates directly on the information sequence econd RSC encoder operates on 
the in Lei leaved infoimation sequence which is interleaved by the interleaver 1 and 
thud RSC encodei also operates on the interleaved information sequence which is 
interleaved by the second interleaver This turbo encodei is a rate quarter encoder 
Punctuting can be used to increase the rate Fig 2 14 shows a multiple encoder with 
three encoders 



Fig 2 14 Multiple turbo encoder 
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The MAP dlgoiithm must be modified in order to take into lccount the a pi ion 
infoimation piovidod by the pievious decoding stages E 1 U 1 decodei should use is i 
pnon lnloimation the previous extrinsic information piovided by the othei two 
decodeis The soft output produced by one decoder described in i elation (2 26) should 
now be modified is 

1 XX Y\ ( y 'k m m ) a k ) Pk On) 

UA)=- — + L s (d k ) + log ^, 

2cr XXk.O'* m m ) a k- 1(»») Pk( m ) 

Wheic L ! (c/ A )iepiesents the sum of extrinsic information pio\ided by the othei two 
decodeis 

Multiple tuibo decodei uses thiee MAP decoders MAP decodei 1 uses noisy 
veision of puity bits generated by RSC 1 noisy systematic bits and the sum of 
extnnsic infoimation generated by MAP decoder 2 and MAP decoder 3 Using these 
three values it geneiates extrinsic infoimation which is used by other two decoders 
Similaily MAP decoder 2 uses noisy version of parity bits geneiated by RSC 2 noisy 
systematic bits and sum of extrinsic information generated by MAP decoder 1 and 
MAP decodei 3 and generates extrinsic information to be used by other decoders MAP 
decodei 3 does the same Interleaveis and de interleavers aie used accordingly as it 
used in the standaid tuibo decoder Finally after the last itei ltion a hard decision is 
made foi each bit 
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Chapter3 


Interleaver 


3 1 Introduction 

Intel leaveis are often used to distribute burst errois that can occur in the coded 
signal into single enor per block Buist error is the phenomen i when etiois occur in 
seveial consecutive bits In general after coding at the ti msmittei words aie 
interleaved md sent over the channel At the receiver de intei le ivei is used to reform 
the origin \1 packets Thus if a burst error has occurred duiing the transmission the 
enoi gets distubuted to various packets This is not the case in tin bo coding scheme In 
this scheme interleaver is an integral part of encoder and can diamatically effect the 
peiformance of the tuibo code One of the goals when designing interleavers for turbo 
codes is to le map the information sequence so that at least one of the parity sequences 
always have a high Hamming weight 

The interleaving process scrambles the order of the input symbols d n in time 
while the deinterleaving process unscrambles the recoveied symbols stream into 
onginal stieam Fig 3 1 shows the interleaving and de interleaving piocess 


[ds d i d-i d-7 d i] 


> 


Interleaver 




[dt d-i d 4 di d|] 


[d-i d«i d4 d|] 


> 


Demterleaver 




[d«, d4 d-$ di d|] 


Fig 3 1 Interleaving and de interleaving process 

In turbo codes an interleaver is used between the two component encoders The 
intei leavei is used to provide randomness to the input sequences Also it is used to 
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increase the weight of code words If the input sequences pioduce low weight code 
woid from the encoded then after interleaving encoder2 will have different input 
sequence and hopefully the weight of the code word generated by this encoder will be 
high Thus tuibo code weight is moderate combined from Encoder 1 s low weight code 
and Encodei2 s high weight code 

The intei leaver affects the performance of turbo codes because it directly affects 
the distance piopeities of the code By avoiding low weight code words the BER of 
tuibo code can improve significantly Thus much research has been done on the 
inteileavei design This chapter discusses different kind of inteileavers that are 
commonly used in the turbo code encoder and give some rules for building good 
intei leaveis for use with turbo codes 

3 2 Weight Distribution of Turbo Codes and Interleaver 
Selection Criterion 

The weight distribution for the code words produced by the turbo code encoder 
depends on how the code words from one of the simple constituent encoder are teamed 
with code woids fiom the other encoder If we use component code of Fig 2 1 in the 
turbo encoder the component codes have the minimum distance 5 and 2 The minimum 
weight woid foi the two encodeis would be generated by the weight one input sequence 
(0000 010 0000) with a single 1 This will produce a minimum distance of 7 for 

the ovei all tuibo code because the weight 1 input sequence would always appeal again 
in the othei encodus tegaidless the choice of permutations This motivates the use of 
lecuisive encodei wheie the key ingredient is the recursiveness tnd not the fact that the 
encodeis ue system Uic 

Tot the RSC encodei in fig 2 4 the weight 1 input sequence generates the 
code s infinite impulse response and the output encoded weight is kept finite only due 
to the lielhs teimination at the end of block In the recursive case the minimum weight 
woid for two encqders is generated by the weight 2 input sequence (00000 
0001 11100 00) with three consecutive 1 s However after rindom permutations a 

pattern of thiee consecutive 1 s is not likely to appear again at the mputto the second 


Ik 
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encode! so it is unlikely that two encoders will simultaneously emit minimum weight 
woids In this c ise the minimum distance will be higher than 7 tot the turbo code 

Rccuisive encodeis do not modify the output weight distributions of the 
mdividu il component codes They only change the mapping between the input dat i 
sequences and the output encoded sequences As the previous example lllustiates 
having the same output sequence mapped from a weight 3 input sequence instead of a 
weight 1 input sequence gives the interleaver a chance to break up the offending input 
beloie feeding it to the second encoder 

Now let us considei another input sequence that produces fairly low weights at 
the output of e ich of the encoders the weight 2 sequence (00 00100100 00) This 

sequence is sell teiminating i e it forces the encoder back to the all zero state without 
my hclp*hom the lielhs teim imtion scheme applied at the end of the block The three 
output stieams tint aie encode from this input are of the form (00 0010010 00) and 

(00 00111100 00) with the latter sequence repeated two times In this case the 

nonzuo poition of the output has duration of four bit times the same as the nonzero 
poition of the input If the interleaver does not break this sequence before the input to 
the second cncodei the lesulting total encoded weight will be 10 

Foi companson let us examine the weight 2 sequence (00 0010100 00) 

This sequence is not self terminating because the encoder nevei letutns to the all zero 
state until it is foiccd to do so at the end of block Now the p uity sequence (repeated 
two times) is of the fotm (00 00110101 ) and this sequence continues until the 

ticllis is lummated This sequence accumulates a very large weight unless it staits neai 

the end of the block 

To. t non icuus.vc cncodei neuly all low weight input sequences aie self 
teimm iting The only non self tei min xting sequences aie those whose last 1 occuis 
ne u the end ol the block As i .esult the output weight is veiy stiongly correlated with 
the input weight lo. ill possible input sequences For instance theie are no weight 2 
sequences that p.oduce a very large we.ght in contradist.net. on to the previous 

example foi the RSC encodei in fig 2 4 

The weight 2 input sequence (000 00100100 00) ts not the only self 

te, initiating weigh, 2 sequence fo, the RSC encoder m f,g 2 4 In general weight 2 

sequences with then I s sepa.ated by drf+35 zeros where 8=1 2 are also self 
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terminating unless the last 1 occurs near the end of the block However the weight of 
the encoded output increases linearly with the separation The total encoded weight of 
such a sequence would be 10+48 if there were no permutations With interleaver before 
the second encodei a weight 2 sequence with 1 s separated by d,=38, bit positions will 
be pei muted into other weight 2 input sequence with 1 s separated by di=38-> bit 
positions wheie each 5, (i=l 2) is defined as a multiple of 1/3 If any 8 , is not an 
integei the conesponding encoded output will have a high weight because then the 
convolutional code output is nonself terminating If all 8 , s ue integeis the total 

encoded weight will be 10 + 8 t This weight grows lineai ly with the separation 

i i 

between the 1 s in the input sequence (after permutations) When the 1 s are far apart 
the encoded sequence looks like the code s infinite impulse lesponse up to the point 
where the second stiategically placed 1 terminates the further accumulation of weight 
The coefficient 2 in the expression for total encoded weight of the self 
terminating weight 2 sequence is characteristic of the paiticul u code chosen in fig 2 4 
It measuies the late giowth of the weight of each encoder s output as a function of the 
sepal ation between the two 1 s in the input sequence This coefficient cannot be made 
any laigei than 2 using constraint -length3 code as in fig 2 4 It c in however be made 
smallei ind the lesult is an mferioi turbo code To illustrate this we considei the same 
encodei stiucture as in fig 2 4 except with the role of g| and g is reversed Now the 
minimum distance of the two component code are 5 and 3 pioducing overall minimum 
distance of 8 foi the total code without any interleaver This is ipparently a better code 
but it turns out to be inferior as a turbo code This paradox is explained by again 
considei ing the critical weight 2 data sequences For this code the weight 2 data 
sequence with d,= 28 , bit positions separating the two 1 s pioduce self terminating 
output md hence low weight encoded word if 8 ,= 1 2 In the turbo encoder such 
sequence will be pei muted to have separations d 2 = 2 S-? for the second encoder where 
now each 8 , is defined as a multiple of Vi But now the total encoded weight for integei 

8 ) and 82 is 8 + Y,£ Notice how this weight grows only half is fast with ^8 as the 
m 1 

previously calcul ited weight for the onginal code Cletily it is impoitint to choose 
component codes that cause the overall weight to grow as f 1 st as possible with the 
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individual sep'uations d, 01 8, This consideration outweighs the criterion of selecting 
component codes that would produce the highest minimum dist mce if unpermuted 

The summation ^<5, in the expression for the total encoded weight of the self 

i 

leiminaling weight 2 sequences depends mostly on the choice of the interleaver and 
less on the choice of code For a given set of interleavers this summation would be the 
same foi iny code whose self terminating weight 2 sequences hrve separation d=38 
between the 1 s This approach provides a method to partially separate the problem of 
good intei leaveis fiom the pioblem of picking good component codes Weight 2 
sequence ue not only self terminating sequence theie ue llso rainy weight n 
n=3 4 5 dati sequence that produce the self terminating output and hence low 
encode weight The goal of the interleaver should be to tiansfoim self terminating 
sequence into non self teiminating sequence 

3 3 Types of Interleaver 

In this section we will discuss various type of interleavei s These are as follows 

3 3 1 Random Interleaver 

Rindom tntetleaver uses a fixed random peimutation md mips the input 
sequence tccoiding to the peimutation order For turbo codes l indom interleaveis 
peifoims better than other interleavers This type of intei leavers has very little 
piobability that the self teiminating sequence is mapped to mother self terminating 
sequence foi RSC 2 and theiefore perfoims better than other types of interleaveis 

3 3 2 Block Interleaver 

The block interleaver is most commonly used interleivei in communication 
system This type of interleaver is defined by a matrix having I lows and J columns so 
that interleavei size is N=IxJ It writes in row wise from left to write and top to bottom 
and leads out column wise from top to bottom and left to light Fig 3 2 shows a block 
intei leavet Block interleavers may fail to spread certain sequences for example 
block interleaveis cannot break the weight 4 sequence shown in fig 3 2 Block 
interleaveis are effective if the low weight sequences are confined to one row 
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0 0 0 0 
0 

10 0 1 
c a o o 
0 0 0 0 
10 0 1 

0 0 I 

0 0 0 0 0 J 


Fig 3 2 Block interleaver 


3 3 3 Cncular Shifting Interleaver 

The pei mutation p of the circular shifting interleaver is defined as 
p(i)= (n +s)mod N 

satisfying a<N a is relative prime to N s<N where i is the index i is the step size and s 
is the offset [18] Table 3 1 shows the resulting permutations foi N=8 a=3 and s=0 Fig 
3 3 shows a circulat shifting interleaver with N=8 a=3 and s =0 From fig 3 3 the 
interleavei writes in [0 1 10 10 0 1] and reads out [0 0 0 ! I 1 10] Also it can be seen 
from tnble3 1 that the adjacent bit separation after permutation is either 3 or 5 This 
type of mteileaver has been shown to do a very good job of pet muting weight 2 input 
sequence with high code word weight However because of the legularity inherent in 
this type of interleaver it may be difficult to permute highei weight (weight>2) self 
termin iting input sequence into higher codeword weight 




Write in 

Index i 

Circular Shifted Permutation 

Read Out 
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Table 3 1 Circular -shifting permutation 


1 

0 

l 

2 

3 

4 

5 

6 

7 

P(0 

0 

3 

6 

1 

4 

7 

2 

5 


3 3 4 Semi Random Interleaver 

Semi tandom intet leaver is a compromise between a designed interleaver such 
as block and cnculai shifting interleaver [17] The permutation algorithm for the 
Semuandomn landom inteileaver is descubed below 

Stepl Select 1 1 mdom index ig [0 N 1] 

Step 2 Select i positive integer S< 

Step 3 Comp ue i to pievious S integers For each of the S integcis compare i to see if 
it lies within ± S if i does lie within the range then go back to step 1 Otherwise keep i 
Step 4 Go b tck to step 1 until all N positions have been filled 

The semutndom mterleivei tnes to intioduce some randomness to overcome the 
petmul ition legulanty however algorithm does not guaiantee to finish successfully 



3 3 5 Odd Even Interleavei 

The odd even inteileavei design is specific illy foi i=^tuibo code An i 

=— tui bo code is obtained by punctuung the two coded (nonsystematic) output 
2 

sequence ol in i«~ turbo code However by puncturing it is possible that an 

infoimation (systematic) bit may not have any of it s coded bits (both of the associated 
coded bits m ly be punctuied out) Likewise it is also possible foi an information bit to 
h ive one oi both of its coded bits Explanation of this effect is is follows 

Let us issume that we have a landom sequence of binary data input to a rate one 
half lecuisive encodei ind we stoied only odd coded bits as shown in table 3 2 
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Table 3 2 Odd positioned coded bits 



Xo 

Xi 

x 4 

X5 

Xfi 

X 7 

Xs 

x 9 

yi 

— 

ya 

j 

- 

ys 

— 


- 

y? 


If wo weio to now inteileave the same sequence of buuiy dm in a pseudo landoni 
older encode it and store the even positioned coded bits the lesult would be as in 
Ublc3 3 

Table 3 3 Even positioned coded bits 



X 5 

X| 

Xi 

*8 

x 9 

Xf 

X 4 

X 7 

- 

Zo 

— 

z 4 

— 

z 6 


zg 



The dal i which is ictually sent through the channel is as shown in table 3 4 the 
onginal sequence of information bits as in table 3 2 and a multiplexed sequence of odd 
and even positioned coded bits from both table 3 2 and table 3 3 


Table 3 4 Data sent over the channel 


X| 

X2 

Xa 

x 4 

Xs 

Xfi 

x 7 

Xg 

x 9 

yi 

Z2 

ya 

z 4 



ys 

z 6 

y? 

Z8 

yg 


In table 3 2 all the odd information bits have their own coded bits present Due to the 
pseudo random way of interleaving some of the coded bits stoied in table 3 3 can be 
for even information bits and some for odd information bits For example the coded bits 
z 2 z 4 z 6 are foi odd information bits and coded bit z 8 is for even information bit It can 
be seen fiom table 3 3 that we don t have any coded bits for information bits x 2 x 6 and 
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X8 wheieas we have two coded bits for information bits Xi x-, ind X9 So the coding 
powei is not umfoimly distributed ovei all bits 

Thus if an enoi occurs for an unprotected information bit (without any of its 
coded bits) the tui bo code decoder may degrade on its performance 

The odd even inteileaver overcomes this problem by allowing each information 
bit to hive exactly one of its coded bits As a result of this interleaver the error 
collection capability of code is uniformly distributed ovei all infoimation bits [1 1] The 
lollowing is an ex unple which illustrates this type of inteileavei design 
The mfoi m ition (systematic) sequence x=Ci of N=9 produce a code sequence c 2 of RSC 
encodei 1 Fiom sequence c 2 only the odd positioned coded bits 11 e stored as shown in 
t iblc 3 *5 Note th it the plain subscripts denote the bit position with in a bit sequence 


T ible 3 5 Odd coded bits of sequence c 2 for information Sequence x 


Xi 

X 2 

xa 

x 4 

X<5 

X6 

X7 

Xs 

x 9 

Cai 


C 03 


C 25 


c 7 


c j 


A V 3 block intei loivei is used to peimute the infoimation sequence x foi RSC encodei 
2 is sown m table 3 6 The information sequence x is written in iow wise and reads out 
columnwise The pet muted information sequence produces 1 code sequence d Fiom 
sequence c 4 only the even positioned coded bits aie stoied as shown in table 3 7 


Table 3 6 3x3 block interleavei 


Xi 

X 2 

X3 

x 4 

x<> 

X6 

X? 

Xs 

X9 


Table 3 7 Even coded bits of sequence C3 for permuted information Sequence 


TH 

X 4 

X7 


HH 

Xg 


X 6 

X 9 

- 

C14 

- 

- 

032 

- 

Cl8 

- 

C36 

— J 





ro. the .=- tuibo code the coded btt sequence must then be multiplexed together as 
shown in t iblc 3 8 


r ible 3 8 Information sequence x and multiplexed coded sequence 


X| 

x 4 

*7 

n 

Xs 

X 8 

xs 

*6 

X 9 

Ct ! 

Cs<! 

C27 

Cp 

Co 5 

Cl8 

c 

C3C 

C 9 


Fiorn table 3 8 it can be seen that each information bit has its own coded bits Any 
block intulewei with odd number of rows and odd numbei columns will have this 
pi opu ty 


3 3 6 Mod 2 Intel leavei 

The odd even property of an interleaver can also be achieved by mapping odd 
positioned bit to the odd position and even positioned bit to even position We have 
achieved this without using block interleaver The algorithm for achieving this is as 
follows 

S tep 1 Genu ate an empty intei leavei ai ray of size N 
Step2 Gener ite a i indom number in the lange 0 to N 1 

Step3 Comp u e this number to previously stored number in the may If this number is 
equal to pieviously stored numbers reject it otherwise store this number 
Step4 Calculate the lemainder by dividing the geneiated numbei by 2 
Step5 If the lemaindei is not equal to the remainder of the inteileaver index divided 
by 2 Go back to step2 

Step6 II the anay is completely filled then stop otherwise go b ick to step2 
This inteileaver intioduced some randomness for achieving odd even interleaver 
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Chaptei 4 


Results and Discussion 


The tuibo coding scheme is a relatively complex channel coding scheme The 
tuibo encodei is a pnallel concatenation of two RSC encodeis The turbo code decoder 
consists ol lteiative semi concatenation of two soft output MAP decoders In addition 
picscncc oi intuit- wus at both the encoder and the decodu introduces additional 
complexity in the scheme 

The two mini methods to evaluate perfoimance ol my coding scheme 
including that of tuibo codes are theoretical analysis and computer simulation 
Theoietical andysis of turbo code is very difficult due to the stiucture of the coding 
scheme A few journal papeis analyzed tuibo codes [7] [8] using theoretical appioach 
howevu then lesults do not closely match (too optimistic) to the corresponding 
computu simuhtion it-sulls The theoietical tieatments are bised on assumptions foi 
Uact tbihty of solution and naturally theie would be deviations from the simulated 
lesults Also the theoietical analyses presented in these papeis ue not cleaily described 
uid thus aie difficult to follow Fuithermore the theoietical tppioach often requires 
enoimous imount of computei tun time to find the complete weight distnbution of 
tuibo code woids We due to the limit ttion of time have chosen only the simulation 
tppioach to obtain the peiformance of tuibo codes 

4 1 Simulation Setup 

The simulation setup is composed of two distinct puts namely encodei and 
decoder The simulated turbo encoder consists of two RSC encoders The two RSC 
encodets could be identical or different Random interleave, separates these two 
component encode, s The random inte, leaver is a random peculation of bit order in a 
bit streams This interleaver algorithm is kept fixed once it is generated as the same 
mtei leavei has to be used at the decoder 
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In the basic fonn tuibo encodei is a rate one third encoder Puncturing has 
been applied to make it a rate half encoder Puncturing pattern is similar to the original 
pvpu [1] Tuibo encodei chooses odd positioned parity bit ftom RSC1 and even 
positioned p mty bits from RSC2 

In the liter Uuie teimination aspect of a turbo code is not very well described At 
the tuibo encodei RSC encoder needs to be ptoperly terminated by returning the code 
tnemoiy ot size v to the ill zeio stite These v tails bit cinnot be pi edetei mined ind 
depends upon the encodei state at the end of information block The strategy to obtain 
these v t ills bit h is been descnbed in the chapter 2 We have t iken steps so that the first 
RSC encodei is lei nun ited piopeily whereas the second RSC is lelt open without using 
my tumin ltion scheme 

In the sinaiil ltion we h ive confined our woik to catei to g lussi m ch innels only 
Giussi m chmnel model is a fauly good model for different tiansmission medium The 
gaussnn chmnel (gtussitn noise) is furly easy to constiuct fiorn the basic Gaussian 
disti lbution with zeio means and variance one In our simulation variance of the noise 
is N 0 /2 

Beloie U insmission ovei the channel the BPSK modul itoi maps encoded bit 
streams horn {0 1 ) to { 1 +1 } domain The simulation of tuibo decoder is based on the 
descuption in chaplet 2 Befoie applying the received wotd to the turbo code decoder 
the leceived system ltic and pauty bits aie sepaiated in two stie mas Then this separated 
puity bit s stieam is again sepaiated into two paits first parts contains parity bits of 
RSC 1 and the second part consist of pauty bits of RSC 2 A zeio is substituted at the 
place of punctuicd bits The decodei consists of two inteileaveis two demterleavers a 
fin il hard decision decoder and two soft input/soft output decoders as shown in fig 

2 n 

4 2 Results 

Simulation results for i tuibo code are based on the bit error rate (BER) 
performance over a lange of E b /N 0 For simulation results we choose component RSC 
encodei with geneiator polynomial gi (octal)=7 and g 2 (octa!)=1 foi encodei memory v 
=2 and RSC encoder with generator polynomials gi (octal)— T7 go (octal) 2 
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encodei memoiy v =4 Different parameters affect the perfonnance of turbo code 
Theses puamtteis tie number of iteiations used in the decoding the size of the 
intei lcivei used memory of the encoder type of interleavei ind output puncturing In 
this section lesults of oui simulation me presented Comparisons between the BER foi 
diffeient inteileavei sizes and interleaver types diffeient memory of component 
encodei difleient number of iteiations punctured and non punctuied turbo codes are 
m ide Finally the simulation lesults for dynamic decoding nlgonthm and multiple turbo 
code aie piesented Foi each of the fig shown in this chaptei numbei of iterations used 
in the decoding piocess are twelve We start by looking it the bit enor rates foi 
diffeient numbei ol itti ltions 


4 2 1 Numbei of Iterations 

Table 4 1 and fig 4 1 shows the turbo code BER peitoimance for diffeient 
numbei of iterations Interleaver used for simulation is random inteileaver with size 
equ al to 1 0000 


Table 4 1 Tuibo code BER performance for different iterations (i = 1/2 v -2 N-10000) 



BER 


I 

E b /N 0 (dB) 

E b /N 0 (dB) 

Eb/No(dB) 

E b /N a (dB) 

E b /N„(dB) 

E b /N 0 (dB) 

E b /N„(dB) 


05 

06 

07 

08 

09 

1 0 

1 1 

T] 

9 BI81e 2 

9 1298e 2 

7 8716eT] 

7 5782e 2 

6 6813e 2 

5 5924e 2 

4 5076e 2 

6 

6 6513e 2 

5 85 1 2e 2 

2 4505e 2 

1 8337e 2 

8 9132e 3 

3 9675e 3 

7 7624e 4 

~w 

6 6413e 2 

5 441 le 2 

9 1201e 3 

4 0738e 3 

" 1 5848e 3 

2 6005e 4 

1 2882e 5 


From the ftguie we mteipiet that when number of iterations mciensed from I to 6 the 
perfoimance of turbo code dramatically improves This is because after the information 
is shated between the decoders the decoders have more mfo, matron about the input 
and thus make more accuiate dee, a, on As the number of iterattons mereases 
perfonnance of tutbo code improves However the rate of .movement decreases This 
is because aftei some delation the decoder already gets the picture of the input code 
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and further exchange of output between the decoders does not piovide as much new 
information as those in the first iteration 



E b /N 0 in dB 

Fig 4 1 Turbo code BER performance for different iterations (i=l/2 v =2 N=10000) 

4 2 2 Puncturing 

Table 4 2 shows the BER performance for punctured and non punctured turbo 
codes Numbei of iteiations used in the decoding is 12 Fig 4 2 shows the same result 
in the giaphical format 


Table 4 2 BER performance for punctured and non punctuied turbo code(v =2 N=400) 



BER 

Rate 

E b /N 0 (dB) 

04 

Eb/NoCdB) 

08 

Eb/N 0 (dB) 

1 2 

E b /N 0 (dB) 

1 6 

E b /N 0 (dB) 

20 

r=l/2 

6 6403e 2 

3 2484e 2 

8 2043e 3 

1 3169e 3 

2 6654e 4 

r=l/3 

1 1790e 2 

3 2420e 3 

1 0620e 3 

8 504 le 5 

1 2003 e 5 
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From fig 4 2 it can be seen that non punctured turbo code has better performance as 
compaied to the punctured turbo codes This is obvious since as the output is punctured 
some panty infoimation is lost and therefore the performance of tuibo code decreases 
Punctuungis howevei resorted to mci ease the code rate 



1 2 Eb/N 0 in dfl 6 


Fig 4 2 BER performance for punctured and nonpunctured turbo codes (v =2 N=400) 


4 2 3 Encoder Memory 


Table 4 3 Turbo code BER performance for memory v =2 and v =4 (r=l/2 N=400) 



BER 

memory 

E b /N 0 (dB) 

E b /N 0 (dB) 

E b /N 0 (dB) 

Eb/N 0 (dB) 

E b /N 0 (dB) 


04 

08 

1 2 

I 6 

20 


4 6970e 2 

1 8939e 2 

3 5354e 3 

4 59 14e 4 

7 3169e 5 

V =2 

6 6403e 2 

3 2484e 2 

8 2043 e 3 

1 3 1 69e 3 

2 6654e 4 


37 




















1 OOE+OO 



1 OOE 05 J 1 

04 08 12 16 2 24 

Efa/NoindB 

Fig 4 3 Turbo code BER performance for RSC v =2 and v =4 (t=l/2 N=400) 

Table 4 3 and fig 4 3 show the turbo code BER performance for different size of 
component RSC encoder memory 

As can be seen from the fig 4 3 memory four (v =4) encoder performs bettei 
than the memory two encoder This behavior of turbo code is similar to the 
conventional codes 


4 2 4 Interleaver Size 

Table 4 4 and fig 4 4 shows the BER performance of tuibo code with different 
interleaver size 

As can be seen from table 4 4 and fig 4 4 the peifoimance of turbo code 
improves with the increase in the interleaver size This is because larger the interleavei 
size the bits can be interleaved with larger distance and thus the correlation with 


\ 
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adjacent bits becomes smaller giving better performance of tuibo code m terms of 
accuracy Also note that the improvement in the BER is moie at higher E b /No 


Table 4 4 Turbo code BER performance for different intei level size(r-l/2 v -2) 



BER 

Intel leaver 

size 

E b /N 0 (dB) 

04 

E b /No(dB) 

08 

E b /N 0 (dB) 

1 2 

Et/N 0 (dB) 

1 6 

E b /N 0 (dB) 

20 

N=200 

9 0909e 2 

4 4444e 2 

1 3323e 2 

5 8987e 3 

7 8914e 4 

N=400 

6 6403e 2 

3 2484e 2 

8 2043e 3 

1 3169e 3 

2 6654e 4 


6 7515e 2 

2 6908e 2 

3 9319e 3 

8 08 lOe 5 

2 6900 e 5 



Fig 4 4 Tuibo code BER performance for different interlever stze(r=l/2 v =2) 

4 2 5 Interleaver Type 

Table 4 5 and fig 4 5 show the turbo code BER performance foi different types of 
interleavei 
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Table 4 5 Turbo code BER performance for different types of interleaver 


(r=l/2 v =2 N=441) 



BER 

Type of 

Interleavei 

E b /N 0 (dB) 

04 

Eb/N 0 (dB) 

08 

Eb/N 0 (dB) 

1 2 

E b /N 0 (dB) 

1 6 

Eb/N 0 (dB) 

20 

Random 

6 5403e 2 

2 2484e 2 

7 5567e 3 

8 31 69e 4 

2 6454e 4 

Block 

7 3034e 2 

4 5075e 2 

9 1276e 3 

4 4633e 3 

8 8679e 4 

Odd even 

6 7989e 2 

3 0227 e 2 

8 5867e 3 

1 2505e 3 

4 5239e 4 

Mod 2 

5 1926e 2 

1 3910e 2 

6 9095e 3 

6 1219e 4 

1 6853e 4 



Fig 4 5 Turbo code BER performance for different types of interleaver 
(r=l/2 v =2 N=44l) 

Odd even interleaver is based on the block interleaver with odd number of rows and 
column The size of odd even interleaver is (21x21) Block inteileaver size is (22x20) 
this block interleaver does not satisfy odd even property From fig 4 5 it is observed 
that odd even interleaver and random interleaver has almost the same performance 
whereas mod 2 interleaver performs better than the random and other types of 
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intei leavei This is because mod 2 interleaver has some 1 mdomness along with the 
odd even pioperty and thus has uniform distribution of error collection capability We 
can see that block interleaver has lower performance as compared to the othei 
intei leaveis 


4 2 6 Dynamic Decoding 

During the simulation of turbo code we found that most of the frames can be 
recovered with a small number of decoding iterations There are few frames with many 
enois that need many iterations to achieve better performance Thus varying numbei 
of decoding iterations can be considered The dynamic decoding iteiations would 
depend on the decoding convergence The principle is to stop the decoding if the frame 
is eiroi free Aftei each iteration of decoding the estimated codewoid is complied with 
thit ol the pievious iteiations Whether the code word is enoi fiee can be deteimined 
by the equality of two lesults Decoding process is stopped if the two sets of iteiations 
give the sime lesults Otherwise it continues decoding like the fixed decoding scheme 
Table 4 6 and fig 4 6 show the avenge number of iterations used by dynamic decoding 
scheme with maximum number of iterations being six 

As can be seen from the fig 4 6 average number of iteiations (educes as the E b /No 
incteiscs With this decoding scheme iveinge latency is si & nilic intly leduced They 
can be used for more decoding iterations for the other erroi free pi one This will reduce 
the nvei lge enoi late or this will improve the averaged system lesponse time Both 
ways are beneficial to the peiformance of turbo code 


Table 4 6 aveiage number of iterations used by dynamic decoding scheme 



BER 


E b /N 0 (dB) 

04 

E b /N 0 (dB) 

08 

Eb/N 0 (dB) 

1 2 

E b /N„(dB) 

1 6 


Average 

iterations 

5 96 

5 28 

448 

2 16 

2 52 
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Fig 4 6 aveiage numbei of iterations used by dynamic decoding scheme 

4 2 7 Mixed State Turbo Encoder 

We have simulated a turbo encoder for which the fust RSC constituent code has 
memory two and the second RSC constituent code has memoiy lour This type of turbo 
encodei is called a mixed state turbo encoder Fig 4 7 and t lble 4 7 show the BER 
performance of this code 
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Table 4 7 BER performance of mixed state tui bo encoder 



BER 

Encodei 

E b /N 0 (dB)=0 4 

E b /N 0 (dB)=0 8 

E h /N 0 (dB)=l 2 

E|/N 0 (dB)=l 6 

E b /N 0 (dB)=2 0 

v =4 

4 6970e 005 

1 8939e 002 

3 5354e 003 

4 a914e 004 

7 3196e 005 

Mixed 

6 407 e 002 

3 392e 002 

5 2764e 003 

5 7220e 004 

8 0690e 005 


As can be seen from the fig 4 7 the mixed state turbo code peiforms slightly worse 
than the memory four encoder with a reduced overall complexity 

4 2 8 Multiple Turbo Code 

We h ive extended ptinciple of turbo code A turbo encodei which uses moie th in two 
RSC encodei is called multiple turbo encoder We have used in encodei which uses 
three RSC constituent encoders First RSC encodei operates directly on the information 
sequence second RSC encodei operates on the interleaved inioim ilion sequence which 
is interleaved by the interleaver 1 and third RSC encodei also operates on the 
interleaved infoimation sequence which is interleaved by the interleaved Now we 
present simulation lesults for this multiple turbo encoder RSC encoder used in the 
simulation is the same as in a general turbo code In each of the simulation number of 
iterations used in the decoding is 12 Table 4 8 and fig 4 8 shows the results for rate 
r=l/4 multiple turbo encoder As can be seen multiple turbo code performs better than 
general tui bo code 

Table4 8 BER performance of multiple turbo code (i=l/4 v=2) 


E b /N 0 (dB) 

BER(N=400) 

04 

1 1414e 002 

08 

2 31 16e 003 

1 2 

A 1783e 005 

1 6 

7 3388e 007 
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Table4 9 BER performance of multiple tuibo code (i = 1 /B v=2) 


E b /N 0 (dB) 

BER(N=400) 

04 

6 5327e 003 

08 

1 4657e 003 

1 2 

6 2814e 004 

16 

7 703 le 005 


1 00E+00 


1 00E 01 


1 00E 02 


1 00E 03 


1 00E 04 

04 08 12 16 2 
Eb/NO in db 

Fig 4 10 BER performance of multiple turbo code (r= 1/2 v=2N=400) 

Table 4 10 BER performance of multiple turbo code (r= 1/2 v=2N=400) 

BER 

E b /N 0 (dB) [ E b /N 0 (dB) I E b /N 0 (dB) 

04 08 12 
6 1307e 002 5 7789e 002 3 4673e 002 

5 1300e 002 2 9397e 002 5 7789e 003 


Puncturing 

pattern 

(PI) 

(P2) 


E b /N 0 (dB) 

1 6 

3 2663e 002 
2 2841e 004 
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Table 4 10 and fig 4 10 show the result of rate half multiple tuibo encoder Two 
puncturing pattern has been applied for achieving rate half multiple turbo code In the 
fust punctui mg pattein (PI) parity bits of RSC 2 and RSC 3 has been completely 
deleted and in the second puncturing pattern (P2) parity bit of RSC1 has been 
completely deleted whereas for RSC 2 even positioned parity bits have been deleted 
and for RSC2 odd positioned parity bits have been deleted 

As can be seen from the fig 4 10 second punctunng pattern (P2) performs 
much better as compared to punctunng pattern (PI) During the simulation of fust 
puncturing pattern we found an interesting result that the perfotm nice does not improve 
with the number of iterations The performance aftei iteiation 12 is the same as it is 
aftei iteiation 1 This is because due to the deletion of parity bits horn RSC1 and RSC2 
these encoders do not have any additional information that m ty be used as the extrinsic 
information for the RSC1 and therefore performance does not impiove with the numbei 
of delations 

Fig 4 1 1 shows the relative performance of different rates multiple turbo code 
For rate half puncturing pattern (P2) has been used for comparison 



Eb/NO m dB 

Fig 4 1 1 BER performance of different rate multiple turbo code (N=400 v=2) 
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From the fig 4 11 it can be inferred that at low Eb/N 0 late one third code performs 
slightly bettei than the rate quarter code whereas at higher E|/No rate quarter code 
perfoims much bettei than the rate one third code Rate half code performance is lowei 
than the other two codes 



Fig 4 12 Relative BER performance of multiple turbo code md standard tuibocode 

Fig 4 12 shows the relative performance of rate quartei multiple turbo code and 
stmdud tuibo code Foi standaid turbo code both iate hilf ind i tie one thud code his 
been used for comp uison 

As can be seen fiom the fig 4 12 that multiple tuibo code (r=l/4) peifoims 
much bettei than the standard turbo code (r=l/2r=l/3) A multiple turbo code with 
mteileavei size N=400 has better performance than a standaid tuibo code with 
mteileivei size N=10000 and thus for multiple turbo code we can achieve bettei 
performance for smaller interleaver size But since we ate using one more MAP 
decodei in multiple tuibo decoder overall decoding complexity has increased So use of 
multiple tuibo codes is a tradeoff between the decoding deity due to the large 
interleaver size and decoding complexity 
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Chapter 5 


Conclusion 


In lecent yeais tuibo codes have been presented to countei tct the effect of channel 
noise Theses codes require lower Eb/No for attaining a certain BER In this thesis we 
have examined the erroi performance of tuibo codes for m tny different cases 
Simulation results have shown many interesting properties of tuibo code that are m the 
same direction with current published research work We found that increasing the 
number of iterations in the decoding process improves the peifoimance of turbo codes 
We also found that the choice of interleaver is essential to get good 
performance The inteileaver size should be as large as possible The choice of 
mtei leaver size is a tradeoff between the better performance and longer decoding delay 
The type of interleave is also important Our results show that the pseudo landom 
inteileaver is a good choice compared to block interleaver Also foi the punctured turbo 
codes mod 2 mterlevei peiforms better than pseudo random inteileaver 

Choosing the size of encoder memory optimally also impioves the peiformance 
but higei memoiy me ms higher decoding complexity With the use of dynamic 
decoding algonthm average number of iterations reduces as the Ei/No mci eases With 
this decoding scheme average latency is significantly reduced They can be used for the 
othei eiror free pi one This will reduce the average enoi rate 01 this will improve the 
aveiage system response time Thus using the dynamic decoding llgonthm we may get 
impioved system time response or better error performance We found that multiple 
turbo codes peiform better than the standard turbo codes We can use small size 
interleaver without any degradation in error performance however decoding 
complexity of multiple turbo code is larger than that of the st indard turbo code Thus 
use of multiple tuibo code is compromise between the decoding delay due to the large 
interleave! size and decoding complexity 
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Future Work 

Theie aie many directions for continued research in turbo codes As shown in the thesis 
some detailed woik needs to be done on the aspect of interleavei design Piesently this 
issue is not very well understood As for further improvements in tuibo code research 
should be focused on the joint issue of improving decoder peifoimance and reducing 
decoding complexity Also developing simple analytical bound toi iterative decoding 
is impoitant Fuithermoie for feasibility considerations issue involved in DSP 
implementation of the turbo code decoder will be important when turbo codes are 
implemented in real systems Finally it may be interesting to find out whether schemes 
can be devised which combine good modulation techniques with the turbo codes 
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